Automatic Short Answer Grading With SemSpace Sense Vectors and MaLSTM

نویسندگان

چکیده

Automatic assessment of exams is widely preferred by educators than multiple-choice because its efficiency in measuring student performance, lack subjectivity when evaluating response, and faster evaluation time the consuming manual evaluation. In this study, a new approach for Short Answer Grading (ASAG) proposed using MaLSTM sense vectors obtained SemSpace, synset based embedding method built leveraging WordNet. Synset representations Student's answers reference are given as input into parallel LSTM architecture, they transformed sentence hidden layer vectorial similarity these two representation computed with Manhattan Similarity output layer. The has been tested Mohler ASAG dataset successful results terms Pearson (r) correlation RMSE. Also, case study specific (CU-NLP) created from exam “Natural Language Processing” course Computer Engineering Department Cukurova University. And it achieved correlation. experiments show that system can be used efficiently effectively context-dependent tasks.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Automatic Short -Answer Grading System (ASAGS)

Automatic assessment needs short answer based evaluation and automated assessment. Various techniques used are Ontology, Semantic similarity matching and Statistical methods. An automatic short answer assessment system is attempted in this paper. Through experiments performed on a data set, we show that the semantic ASAGS outperforms methods based on simple lexical matching; resulting is up to ...

متن کامل

Distributed Vector Representations for Unsupervised Automatic Short Answer Grading

We address the problem of automatic short answer grading, evaluating a collection of approaches inspired by recent advances in distributional text representations. In addition, we propose an unsupervised approach for determining text similarity using one-to-many alignment of word vectors. We evaluate the proposed technique across two datasets from different domains, namely, computer science and...

متن کامل

Text-to-Text Semantic Similarity for Automatic Short Answer Grading

In this paper, we explore unsupervised techniques for the task of automatic short answer grading. We compare a number of knowledge-based and corpus-based measures of text similarity, evaluate the effect of domain and size on the corpus-based measures, and also introduce a novel technique to improve the performance of the system by integrating automatic feedback from the student answers. Overall...

متن کامل

Wisdom of Students: A Consistent Automatic Short Answer Grading Technique

Automatic short answer grading (ASAG) techniques are designed to automatically assess short answers written in natural language having a length of a few words to a few sentences. In this paper, we report an intriguing finding that the set of short answers to a question, collectively, share significant lexical commonalities. Based on this finding, we propose an unsupervised ASAG technique that o...

متن کامل

A Fluctuation Smoothing Approach for Unsupervised Automatic Short Answer Grading

We offer a fluctuation smoothing computational approach for unsupervised automatic short answer grading (ASAG) techniques in the educational ecosystem. A major drawback of the existing techniques is the significant effect that variations in model answers could have on their performances. The proposed fluctuation smoothing approach, based on classical sequential pattern mining, exploits lexical ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2021

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2021.3054346